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Abstract 

We study K-processes, which are Markov processes in a denumerable state space, all 
of whose elements are stable, with the exception of a single state, starting from which the 
process enters finite sets of stable states with uniform distribution. We show how these 
processes arise, in a particular instance, as scaling limits of the REM-like trap model "at 
low temperature", and subsequently derive aging results for those models in this context. 
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1 Introduction 

In this paper, we study some properties of a family of Markov processes, which we call Re- 
processes, in particular, and that's our main motivation, its relationship in a special case 
with the scaling limit of a trap model associated to the Random Energy Model (REM) at 
low temperature, as well as with the aging phenomenon exhibited by that model [1]. These 
processes are thus prototypes of infinite volume dynamics for low temperature (mean field) 
spin-glasses. 

They have the following remarkable characteristic property. Their state space is denumer- 
ably infinite (we take it to be {1, 2, . . . , oo}), with a single unstable state, where by unstable 
we mean that the process spends time at that state at each visit to it; as we'll see, that state 
may be either instantaneous or fictitious (which are standard terms) in different cases. When 
in a stable state, the process waits for an exponential time and jumps to the unstable state, 
starting from which, and here's the striking feature, it enters any finite set of stable states with 
uniform distribution. In the context of spin glasses, the stable states represent the low energy 
configurations, and the unstable state represents the high energy configurations. The apparent 
paradox of the uniformity property is elucidated by a summability condition on the inverse of 
the jump rates. 

It turns out that a class of processes with this uniformity property was introduced by 
Kolmogorov as an example of a Markov process with an instantaneous state, thus not satisfying 
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his equations in their usual form [2] , and it has subsequently been considered by many authors. 
This class comprises all members of the family we study in the present paper but for an 
important special case, precisely the one related to the trap model. See Remark 3.2 below for 
more details. 

We have two approaches: an analytical one, based on Dirichlet forms, introduced in Sec- 
tion 2; and one based on an explicit probabilistic construction, in Section 3, at the end of which 
we argue the equivalence of both points of view. In Section 4, we derive a characterization 
result for K-processes. Section 5 is devoted to the scaling limit of the REM-like trap model, 
and to deriving an aging result for the associated K-process in this context, which can be seen 
as an aging result for the trap model itself. 

Aging is a dynamical phenomenon observed in disordered systems like spin-glasses at low 
temperature, signaled by the existence of a limit of a given two-time correlation function of 
the system started at a high temperature configuration/state, as both times diverge keeping 
a fixed ratio between them; the limit should be a nontrivial function of the ratio. This is 
thus a far-from-equilibrium phenomenon. It has been observed in real spin glasses and studied 
extensively in the physics literature. See [3] and references therein. 

In [1], a phenomenological model for a Glauber dynamics for the Random Energy Model 
(REM) is introduced, namely the trap model (in the complete graph), and an aging result for 
that model established. See more on the the trap model and what is meant by an aging result 
in Section 5. Roughly speaking, the trap model is a symmetric continuous time random walk, 
typically in a regular graph, finite or infinite. The jump rates at the vertices are i.i.d. random 
variables with a polynomial tail at the origin, whose degree is related to temperature, so that 
degree less than 1 is equivalent to low temperature. We'll assume this regime throughout. 

In the mathematics literature, much attention has recently been given to the trap model, 
and many aging results were derived for it. In [4, 5], the trap model in the hypercube is studied, 
with the rates given by energies of the REM associated to the vertices of the hypercube. The 
aging result obtained in [5] is for the same correlation function as one considered in [1] with 
the same limit, in this fashion giving support to the phenomenology underlying the adoption of 
the trap model by the authors of the latter paper. In [6] , among other results, the aging result 
in [1] aluded to above is established in a mathematically rigorous fashion. 

The trap model in Z was considered in [7] and [8]; the one in Z 2 , in [9, 10]; the one in Z d , 
d > 3 in [10]. In [11] a comprehensive approach to obtaining aging results for the trap model 
on a class of graphs, including Z d and tori in two and higher dimensions, the complete graph, 
the hypercube, is developed. 

In most of the above cited work, aging is derived for given correlation functions, without 
specific regard to the fact that aging may arise as a scaling property of the full dynamics. As 
in [7] and [8], we follow the latter approach for the trap model in the complete graph, and 
derive its scaling limit (see Theorem 5.2 below); aging results follow (after a further limit is 
taken, as explained below; see also Theorem 5.8 and Corollary 5.11 below). 

It should be noted that, since a time divergence is involved, the scaling limit of the rates 
(or alternatively the average holding times) should be taken together with the scaling limit 
of the dynamics, the limiting object acting as a disordered set of parameters for the limiting 
dynamics. The rescaling is of time only (in such a way that the lowest rates are of order 1), 
since space isn't relevant for the model in the complete graph. The scaling limit results as 
roughly speaking a dynamics in the deepest traps (but the remainder states play a role: they're 
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lumped together in the limit in a single unstable state). 

In this model, in the scaling limit, aging is a phenomenon of the dynamics at vanishing 
times: at order 1 or larger times the dynamics is close enough to or in equilibrium, in contrast 
to the one dimensional case of [7] and [8], where it could be said that aging occurs for fixed 
macroscopic times. This should be compared to the aging result in [1] and [6], alluded to 
above, which takes place in a large microscopic time regime (in our case, it occurs at short 
macroscopic times), and also to the aging result of [11] for the complete graph, taking place 
at mesoscopic time scales; as far as the three regimes can be compared, they coincide, perhaps 
not surprisingly. See Remarks 5.3 and 5.4. 

By taking the scaling limit first, and the aging limit after, we can see aging as a macro- 
scopic phenomenon (taking place in the limiting dynamics). We point out that the latter limit 
holds for almost every realization of the underlying (macroscopic) disorder: Theorem 5.8 and 
Corollary 5.11 are almost sure aging results. 

The scaling limit for the trap model isn't relevant only as a background for aging, even 
though that's our main motivation for taking it in this paper. It contains also information 
about other important features of the dynamics at long microscopic times: from aging at short 
macroscopic times, to approach to equilibrium at large macroscopic times. So it has an interest 
of its own. Inasmuch as the REM is a prototype for a (mean-field) spin glass, and the trap model 
in the complete graph is a prototype for a Glauber dynamics for the REM at low temperature, 
this scaling limit turns up as a prototype for an infinite- volume dynamics of a (mean-field) spin 
glass at low temperature. We expect the same process to arise as an appropriate scaling limit 
for the trap model in the hypercube (as dimension diverges), and also for the hopping dynamics 
for the REM, either in the complete graph or the hypercube. It is conceivable that it will also 
be the scaling limit of the Metropolis dynamics for the REM in the hypercube (see, e.g., [12] for 
a definition of this dynamics). We also expect variants of the K-process to show up as scaling 
limits for dynamics of other mean-field models at low temperature, like the GREM, and that 
they will also exhibit aging. 

Our first step in this study is to describe the class of processes that arise as the scaling limit 
of the trap model in the complete graph. Since they are closely related to the above mentioned 
class of processes introduced by Kolmogorov through the above mentioned uniformity prop- 
erty, which turns out to characterize the family consisting of both classes (see Section 4 and 
Theorem 4.1), we chose to start by defining, constructing and studying relevant properties of 
that larger family, which we refer to as K-processes. 

As mentioned above, we do that analitically, through the Dirichlet form associated to the 
process (in Section 2), and, alternatively, through a probabilistic construction (in Section 3). 
The former way has the advantage that the K-processes (are reversible and) have quite simple 
Dirichlet forms, which facilitate the analysis of quantities like the Green function (see Subsec- 
tions 2.2 and 2.3). 

The probabilistic construction, besides having its own interest, allows for a direct analysis 
of the scaling limit for the trap model and the aging issue, without the need of taking trans- 
forms 1 , and entails the inclusion of more general aging functions in the analysis and results (see 
Theorem 5.8 and Corollary 5.11), at little extra effort. See Section 5 and Subsection 5.1. 

The analytical construction also leads to simple derivations of aging results in a weak sense, 

x But we do rely on a Tauberian theorem at a specific point of our argument; see proof of Theorem 5.8. 
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after taking Laplace transforms. See beginning of the proof of Theorem 5.8. 

In connection with another area of research, as we briefly discuss in Remark 4.2 in Section 4, 
a K-process can be viewed as a one-point extension of a Markov process beyond its killing time, 
an object which is of current interest [13, 14]. 

2 Dirichlet forms approach 
2.1 Construction 

Let N* the be one point compactification of N* = {1,2,.. .}, with oo denoting the extra point. 
In other words, we take N* with any fixed metric d making it compact. For definiteness, take 

d(x,y) = \x- 1 -y- 1 \,x,yeW (2.1) 

(with oo" 1 = 0). 

Let 7 : N* -> (0, oo) be such that 

x£N* 

We extend 7 to N* by declaring 

7(00) = 0. (2.3) 
Let C be the space on continuous real valued functions on N* and define 

V = {/ : N* - R s.t. J2(f( x ) ~ /(°°)) 2 < °°} • ( 2 - 4 ) 

X 

('Xlx' usually stands for 'XlxeN*'-) Note that V is a dense subset of C. 
For f,gET>, consider the bilinear symmetric form 

£(/, 9) = " f(°°))(9(x) ~ 9(oo)) . (2.5) 

X 

Lemma 2.1 (S,V) is a regular Dirichlet form acting on L 2 (N*,7) in the sense of [15]. 

Proof First note that 7 has full support since we have assumed that 7(2;) > for all 16N*. 

Clearly S is bilinear and symmetric. We should check that T> C L 2 (W, / ~f): let / e T>. 
W.l.o.g. assume that /(oo) = 0. Therefore S(f,f) = J2 x f{x) 2 < 00 and J2 X f(x) 2/ y(x) < 
(snp x -f(x))J2 x f(x) 2 < 00. 

It is easy to check that contractions act on £ so that 8 is a Markovian form. 

The last point is to prove that D is complete for the norm induced by the bilinear form S: 
assume that f n G V satisfies f n — > in L 2 (W, 7) and £ (f n — f m , f n — f m ) — > as n and m tend 
to 00. Then we must have f n {x) — > for any 16N* (because 7(2;) > 0). Also, for any e > 
there exists no s.t. for any n,m > no and any x G N*, 

|/ n (a;) - /„(oo) - fm(x) + f m (oo)\ < e. 
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(This comes from the assumption £(/„ — f m , /„ — f m ) — > 0.) Letting m go to oo and then x 
go to oo, we get that limsup m |/ m (oo)| < e and therefore f m (oo) -^Oasm tends to oo. By 
Fatou's Lemma, 

£(fmfn) = y^(fn(x) - f n (oo) 2 = lim inf (f n (x) - f m (x) - /„(oo) + / m (oo)) 2 

X X 

< lim inf V7/ n (x) - f m (x) - /„(oo) + / m (oo)) 2 = lim inf £(f n - f m , f n - f m ) , 

m ^— ' m 

and therefore £(/„,/„)—> 0. ■ 

Remark 2.2 W^e conclude from the above lemma that there exists a strong reversible Markov 
process, in fact a Hunt process, whose Dirichlet form is (£,T>) on L 2 (N*,7). We shall denote 
it by (F x ,x EW),(P t ,t>0). 

2.2 Computation of hitting times and capacities 

Given the explicit enough form of £ it is easy to compute the law of some hitting times and 
entrance laws. 

Lemma 2.3 Let r x = inf{t; X(t) ^ x}. Then 

E » (<rte) = TTW (2 ' 6) 

Proof The function y — > E, y (e~~ XTx ) is the minimizer of the expression £(u,u) + A7(n 2 ) among 
functions u satisfying u(y) = 1 for y ^ x. But, for such a function u, we have £(u, u) + \ r y(u 2 ) = 
(u(x) — l) 2 + \ / y(x)u(x) 2 + A(l — 7 (x)) that is minimal for u(x) = ■ ■ 

Lemma 2.4 Let = inf{t; X(t) = oo}. Then 

e ^- x '"> = ttW (2 ' 7) 

Proof We now have to minimize £(n, u) + A7(n 2 ) among functions u satisfying -u(oo) = 1. But 
for such a function u, we have £(n, n) + A7(n 2 ) = ^2 x (u(x) — l) 2 + Xj(x)u(x) 2 that is minimal 

for u ( x ) = TTaW • ■ 

Remark 2.5 In particular note that < oo F x .a.s. Hence we// defined. Since 

F- x (e~ Xa °°) = E 2 .(e _Ar:,: ) and r x < a^, we must have r x = F x .a.s. In particular X(t x ) = oo 
F x .a.s. 

Lemma 2.6 Let A be a finite subset of N* of size n, and r A = inf {t ; X(t) G A}. Then, for 
any function f : A — > R ; any A > and any y A, we have 

E y (f(X TA )e-^)) = 1 £ /(,) . (2.8) 

n + (1 + A 7 (y)) E^a ITW 

In particular, for X = 0, we find that the law of X{r A ) is uniform over A. 
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Proof We have to minimize £(u, u) + A7(w 2 ) among functions u satisfying u(x) = f(x) for 
x G A. For such a function £(u, u) + \^{u 2 ) = J2 xeA (f(x) — u(oo)) 2 + J2 x <£a( u ( x ) — -u(oo)) 2 + 
\ / y(x)u(x) 2 + A J2 xeA ^f(x)f(x) 2 . The solution has the form u{y) = for y ^ A and we 

find «(oo) by minimizing ^ xeA (f(x) - u(oo)) 2 + u(oo) 2 Wx%)- ■ 

After a similar computation, we get the following. 
Lemma 2.7 Let A be as in the previous lemma. Then 

EMX^e-^)) = 1 m fix) ■ (2-9) 

n + l^xfA 1+A 7 (x) xeA 

It is also possible to compute the Green kernel 

POO 

g x (x) = A / e- As P 00 (X(s) = x)als. (2.10) 
Jo 

The Markov property gives: 

g x {x) = E 0O (e- ATW )(l - E x (e- XT *)) + E^e'^^E^e-^g^x) . (2.11) 
(Remember that X(r x ) = oo a.s.) Using Lemma 2.6, we get that 



^2/ 1+A7(j/) 



We also have the following more general formula. Let g\{x,y) = A / °°e Xs ¥ , y (X(s) = x)als. 
Then 

= 1 + A 7 (y) gA(x) " (2 ' 13) 

The last formula describes some correlation function whose definition is motivated by so- 
called aging. 



Lemma 2.8 Let 

Then 



poo poo 

/ \e~ Xs ds I fj&-i*dtF 00 (X(u) = X(s)Vue[s,s + t]). (2.14) 
Jo Jo 



E 



At(x) /J7(a;) 
x I+A7O) 1+/U7(x) 



^) = r ^^- ( 2 - 15 ) 

^x 1+A7(x) 

Proof. As for the Green function, we use the Markov property to write that 

poo poo 

c A (/i) = ^/ Xe~ Xs ds pie->* t dtF 00 (X(s) = x; X(u) = xVue[s,s + t\) 
x Jo Jo 

poo poo 

= V/ \e- Xs ds iie->* t dtF 00 (X(s) = x)F x (T x >t) 
= ^OrXl-E^e-^)). ■ 
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2.3 Some extension 



Let c > and define the new measure 7 C = 7 + cS oq. The bilinear form (S,T>) turns out to 
be also a Dirichlet form when acting on L 2 (N*, 7 C ). The corresponding Markov process can 
be described as follows: let L(t) be the local time of X at 00. (L(t) is the unique additive 
functional whose Revuz measure is Soo-) Define 

A c {t) = t + cL(t) and X c (t) = X(A-\t)). (2.16) 

Then, under F x , X c is a Markov process and its Dirichlet form is (S,V) acting on L 2 (N*, 7 C ). 
Call P£ its law when starting from x. 

One can then reproduce the same computation as before. In particular we get the expression 
of the Green function: 

-Vy(g) 



and, since ^(00) = 1 - ^^(i), 



cA 



We finally have that 



g c (oo) = rT ^. (2.18) 

CA Z^x l+A 7 (x) 



gA^.!/)= i + A7(y) ^), ^eN* (2.19) 



Remark 2.9 It follows from the character of the time change (2.16) that for all c >0, at the 
entrance time of finite subsets A ofN* by X c , starting outside A, its distribution is uniform in 
A. See [15], Section 6.2, in particular Theorem 6.2.1. 



3 Probabilistic point of view 

In this section we make an explicit construction for the processes introduced in the previous 
section, and study some of its properties which are relevant for what follows. 

Let M = {(N^) t > , x G N*} be i.i.d. Poisson processes of rate 1, with the j-th event 

time of N^ x \ and T = {T ; % > 1, x G N*} be i.i.d. exponential random variables of rate 1. 
M and T are assumed independent. 
For c > and y G N*, let 

OO JV t 

r(t) = r^(t) = 7 (y) T + 7(*) E T ^ + ct ' ( 3 - 2 °) 

X = l 1 = 1 

where, by convention, Y^=i = for every x. 
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Let c > be fixed. We define the process X c,y on N* starting at y G N* as follows. For 
t > 

(y, if 0<i < 7 (y)T , 
X c (t) = X c > y (t) = fx, if I>f } -) < t < I>f } ) for some 1 < j < oo, (3.21) 
[oo, otherwise. 

Definition 3.1 We call X c,y the K-process with parameters 7 and c. We will also call it 
sometimes the K(y,c) '-process for shortness. 

Remark 3.2 The case c = 1 was introduced by Kolmogorov [2] as an example of a Markov 
process in a countable state space with an instantaneous state. It is known in this context as the 
first example of Kolmogorov or Kl (Kolmogorov also introduced a second such example, known 
as K2, which is not a K-process by our definition for any c > and 7 ). The case c = 1 was then 
studied in [16] and [17] (Example 3 in Part II, Chapter 20 of the latter reference), where an 
equivalent construction to the above one is given, and elsewhere (e.g., [18]). The general case 
of c> isn't really different from the one introduced by Kolmogorov; one can go from one case 
to the other by a uniform deterministic time rescaling. The c = case is already considerably 
different. For one thing, it is not strongly continuous (where by strong continuity of a process Y 
in N* we mean that \im t ^o¥ x (Y t = y) = 5 xy , the Kronecker's delta, for all x, y G N*; as result 
of the result of Lemma 3.14 below, this property is seen to fail for the K-process with c = for 
x = y = 00), which the Kl process is; following Levy's classification [19], the K-process is of 
the fourth kind for c = 0, and of the fifth kind for c > 0. 2 Even though the c = case is a 
natural extension of the c > one, we didn't find any explicit mention to it in the literature. 
(In [19], though, it is argued in general terms that by looking at a fifth kind process outside the 
instantaneous state, one gets a fourth kind process.) Nevertheless we will show that precisely the 
c = case arises as the scaling limit of a (mean-field) disordered spin dynamics (the REM-like 
trap model in the complete graph) at low temperatures. Its irregular behavior near 00, associated 
in particular to its lack of strong continuity, is behind the aging phenomenon exhibited by such 
dynamics at such temperatures [1]. 

Remark 3.3 It is clear that X c ' y (0) = y almost surely for all j/GN*. That this also holds for 
y = 00 follows readily from (3.21). 

Remark 3.4 Note on the one hand thatT , T(a^— ), T(a^) are continuous random variables 
for every x G N* and j > 1, and on the other hand that X c,y is almost surely continuous off 
{7(1/) T ; T(o-j xS) — ), T(o-j xS) ), x G N*,j > 1}. These readily imply that every s > is almost 
surely a continuity point of X c,y . 

Remark 3.5 It readily follows from (3.21) that 

X c > y (t) = X c <°°(t - 7, T ), for t > 7, T . (3.22) 

2 According to this classification, 00 is termed a fictitious state, rather than an instantaneous state, when 
c = 0. 
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Proposition 3.6 X c is cadlag and Markovian. 

Remark 3.7 A treatment of the case c = 1 can be found in [16] and [17]. Even though both 
have a construction equivalent to ours, complete proofs of some key properties of the constructed 
process, like the Markov one, are not presented. For this reason, and in order to include the 
c = case as well, we present below a proof of Proposition 3.6. 

The proof is based on strongly approximating X c in Skorohod space by Markov processes 
that we now define. For n > 1 and y G {1, . . . , n, oo}, let 

n " t 

r„(f) = r?(t) = i{y) t + £ 7 (*) £ ii x) + a (3.23) 

x=l i=l 

and 

(y, ifO<t< 7 (2/)T , 
X$ y (t) = I x, if T n (af ] -) < t < T n (af ] ) for some 1 < x < n, j > 1, (3.24) 
[oo, otherwise. 

Remark 3.8 We note that X®' y never visits oo, even when y = oo. See next remark. 

Remark 3.9 The order in which the sites of {1, ... ,n} are visited by X^ y (in case y is finite, 
after leaving the initial state) is given by the respective (chronological) order of {a^; 1 < x < 
n, j > 1}. Let us denote the latter set by S n = {S?, S%, . . .}, with S? < S% < .... Then 
S n is a Poisson point process of rate n, each point of which is labeled according to a different 
element of an i.i.d. family of uniform in {1, . . . ,n} random variables. This implies that the 
jump probabilities of X^ y from any site in case c = 0, and from oo in case c > 0, are uniform 
in {1, . . . ,n} 7 and also implies that X®'°°(0) is uniformly distributed in {1, . . . ,n} (since it is 
the label of S™; see previous remark). 

In case c > 0, c(S" — S^_{), i > 1, where Sq = 0, represent the successive holding times at 
oo. It is clear then that these times form an i.i.d. sequence of exponential random variables of 
mean c/n. 

We have the following two results. 

Lemma 3.10 X r n is cadlag and Markovian for every n > 1 and y e {1, . . . , n, oo}. 
Lemma 3.11 X^ — > X c as n — > oo almost surely in the Skorohod norm for every y e N*. 

Proof of the first assertion of Proposition 3.6 

The first assertion of Lemma 3.10 and Lemma 3.11 readily establish the first assertion of 
Proposition 3.6 (see [20]). ■ 

Proof of Lemma 3.10 

Let the starting point y be fixed. 
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For c = 0, X^ is the following Markov process on {l,...,n}. X% y starts at y if y G 
{1, . . . ,n}; X%°° has uniform initial distribution. When at x G {1, . . . , n}, it waits an expo- 
nential time of mean 7(2;) and then jumps uniformly at random to a site in {1, . . . , n} (which 
could be x again). See Remarks 3.8 and 3.9 above. 

For c > 0, X^ is the following Markov process on {1, . . . ,n, 00}. X^ v starts at y. When 
at x G {1, ... , n}, it waits an exponential time of mean 7(2;) and then jumps deterministically 
to 00. When at 00, it waits an exponential time of mean c/n, and then jumps uniformly at 
random to a site in {1, ... , n}. See Remark 3.9 above. ■ 

Proof of Lemma 3.11 

Let y be fixed, and suppose n > y if y G N*. We show the almost sure validity of (c) of 
Proposition 5.3 in Chapter 3 of [20] (page 119). 

For m G N*, let 5 m = diam{x G N* : x > m} = (m + 1) _1 and {S™ < S™ < . . .} = 
{ a j X \ J > 1> 1 < ^ < m }> with the latter being well defined almost surely. Fix T > and let 

L™ = min{* > 1 : r B (5J») > T}, (3.25) 

which is almost surely finite, and make S™ = 0. Notice that = L™(y), is nondecreasing in 
y, where y is the starting point, and thus 

maxL™(y)=L™(oo). (3.26) 

j/GN* 

We can now almost surely find n m so large that mino<j<L^-i[r n (5'^L 1 — ) — r n (S?)] > for 
n > n m 3 . For these n then define A™ : [0, r n (S'™m)] — > R + inductively as follows. 

K(t)=t, if 0<t< 7 (y)T , (3.27) 

and for < i < L™ - 1 and T n (S?) < t < T^S^), let 

xm(t) = fns?) + r';g;:;:rg) [* - r^ni, * w) < t < r n (^-), 2 

1 r(^-) - r n (^-) + 1, if r n (^-) < t < r n (s? +1 ). 

It has the following properties. For all T > 0, m G N* and n > m V n m V y 

K(t) > t, < t < T, (3.29) 
sup |A?(f) - t| < max {r(^-) - r„(S'™ 1 — ); < i < L™(oo) - 1} (3.30) 

0<t<T 

(where we have made use of (3.26)), and 

the right hand side of (3.30) vanishes almost surely as n — > 00. (3.31) 

Furthermore, 

sup dist (x c (\™(t)),X c n (t)) < 5 m , (3.32) 

0<i<T v ' 



3 We can take n m = 1 when c > 0. 
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since for t G [0,T], X C (A™(£)) and X°(t) coincide when either one is in {1, . . . , m}. 

From (3.30), for every m G N* there almost surely exists n' m > n m such that for n > n' ni 



sup \^(t)-t\<S n 



0<t<T 



(3.33) 



and (3.32) hold. We may assume (n' m ) is strictly increasing. 

For n > n'ii let m n = i when n[ < n < n' i+1 and A n = A™ n . We then have for T > 

su Po <,< T dist (x c (A n (t)),X^(t)) - (3.34) 
sup < t < T \X n (t) — *| — »- (3.35) 

almost surely as n — > oo, and the above mentioned condition (c) is verified. ■ 

We will also need the further lemma to prove the second assertion of Proposition 3.6. 

Lemma 3.12 For every t > 0, X c ' y (t) — * X c,oc (t) as y — > oo almost surely. 

Proof 

The case t — is clear. For £ > 0, since we are taking y — > oo, we may assume that 
7(2/) T < t and then from (3.22) we have that 



|X c >f (t) - X c '°°(t)\ = |X c '°°(t - 7 (y) T ) - X c '°°(t)| 
and the result follows from Remark 3.4. 



(3.36) 



Proof of the second assertion of Proposition 3.6 

Lemma 3.10 implies that for arbitrary m > 1, < t\ < . . . < t m+ \ and bounded continuous 
functions /1, . . . , / m +i, we have that 



E 



fl\Xn{h)) ■ ■ ■ fm(Xn(tm)) /m+l(^(Wl)) 



E 



/xCX^.-./m^W)* 



n 

tm-\-l 



/m+l(-^n(*m)) 



where \l/ n is the semigroup of X°, i.e., for t > 0, a continuous function / and y eN* 
By Lemma 3.11, the left hand side of (3.37) converges to 



E 



A(x c (t!)) . . . f m (x c (t m )) f m+1 {x\t m+1 )) 



(3.37) 



(3.38) 



(3.39) 



as n — > 00. Let us estimated the right hand side of (3.37) by 



E 



. . . f m (X C n (t m )) % m+1 _ trn fm + l(X C n (t m )) 



(3.40) 
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where for t > 0, a continuous function / and y e N* 

¥ t /(y) = E [/(X^t))] , 

and 

|e n | < const sup \^ m+l _ tm f m+1 (y) - ^t m+1 -t m f m +i(y)\- 



(3.41) 



(3.42) 



From Lemma 3.12, we have that ^ tm+1 -t m fm+\{-) is continuous, and now Lemma 3.11 implies 
that the left term of (3.40) converges to 



E 



/l(X C (il)) . . . fm{X C {t rn )) ^ tm+1 - tm f m+ l{X C {t m )) 



(3.43) 



as n — > oo. 

Let us now examine the right hand side of (3.42). We first relabel f m +\ = 9, tm+i —t m = s 
and 7(y) = 7 y . We have that 



E 



^(X^(s))-^(X^(A„( S ))) 



+ E 



^(X^(A„( S )))-^(X^(s)) 



(3.44) 



with \ n as defined in the paragraph of (3.34), with T > s. From (3.32), it follows that the sup 
in y of the absolute value of the first expected value in the right hand side of (3.44) vanishes 
as n — > oo (since g is continuous, and thus uniformly continuous since N* is compact). 

Lemma 3.11 now implies that there exists a sequence k n going to infinity as n — > oo such 
that as n — > oo 



max 

l<y<k n 



E 



s(X^(A„( S )))-£(X^( s - 7y T )) 



0. 



(3.45) 



We now note that, from (3.29,3.31), A„(s) > s, and that A n (s) — > s as n — > oo uniformly in 
1/ almost surely. From this and (3.22) we then have 



sup 

y>k n 



E 



< E 



sup 

_y>k n 



g(X c >y(\ n (s)))-g(X c 'y( S - ly T )) 



g{X^{\ n {s)- ly T,))-g{X^{s- ly T,)) ; ly T < s 



+ 2||0|| sup P( 7y T > s). 
y>k„ 



(3.46) 



It is clear that the latter summand in the right hand side of (3.46) vanishes asn^ 00. And so 
does the former one, since s is almost surely a continuity point of X c,oc (see Remark 3.4 above). 
We have thus concluded that |e n | — > as n — > 00, and then from (3.37-3.43) we have that 



E 



/i(! c (*i)) . . . / m (* c (U) / m+1 (l c (Wi)) 



= E 



f 1 (X c (t 1 ))...f m (X c (t m ))V 



tm-\-l 



Jm+l{X C (t m )) 



(3.47) 



and the Markov property is established. 
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Remark 3.13 ^ defined in (3.41) is the semigroup of X c . 



Next follows a result establishing in particular the lack of strong continuity of the K-process 
with c = 0. 

Lemma 3.14 For every y G N* ; we have that F(X°' y (t) = oo) = for every t > 0. 

Remark 3.15 The statement of Lemma 3.14 does not hold for c > 0. In this case, it can 
actually be shown that F(X c (t) = oo) > for every t > 0, y G N*. It can also be shown that 
the process is strongly continuous in this case. 

Remark 3.16 We note that X c '°°(0) = oo almost surely for every c > 0. 

Proof of Lemma 3.14 

For m > 1, and t > 0, let 9 m t be the time spent by X°' y outside {1, . . . , m} up to time t. 
Clearly 



x>m i=l 

where S is the inverse function of T. It is also clear that 

f l {oo} {X^{s))ds<e m>t (3.49) 

for every m > 1 and t > 0, where 1. is the usual indicator function, and that 

e m ,t - (3.50) 

almost surely as m — > oo for every £ > 0. Thus the left hand side of (3.49) vanishes almost 
surely and dominated convergence implies that 

E ^jf l {oo} (X°> 1 '(s)) rfs^) = ^ P(X°'^(s) = oo) rfs = (3.51) 

for every t. This proves the assertion of the lemma for Lebesgue-almost every t. The Markov 
property of X°' y can now be used to extend the result to every t. ■ 

We close this section with a computation related to the Green function of X c ; this will lead 
to an identification of X c above and X c defined in Subsection 2.3. 
Let = inf{t ; X c (t) = x}. We have that under 

T {*} = rW(a[% (3.52) 

where for x G N*, s > 

rr ) ( S ) = E^E T ^ ) + cs - ( 3 - 53 ) 

y^x i=l 
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It is now straightforward to compute the Laplace transform of for the process started at 
oo. We obtain 

E 00 (e-^ } )=E 00 (e-^ ) (^ ) )) = 
f °° E(e-^ } W) e- cfe = /~ E(exp {-A £^ 7, EtT ^}) e"* 1 ** ds, (3.54) 



for A > 0, where in the second equality we have used the independence of a[ x ^ and (the random 

variables in) ^ y Ei=a ^ • We leave it as an exercise to compute the expectation inside 

the integral in (3.54), and to conclude that the integral equals 



y^x 



+ • (3-55) 



We note that this expression is the same as that for the corresponding transform for X c in 
Section 2. 

Now, since the only transitions are from states in N* to oo and back, we have a decomposition 
as in (2.11) for the Green kernel of X c starting at oo, and we get the case of general initial 
condition from the case of oo initial condition as in the computation in Section 2. We readily 
conclude from the remark at the end of the previous paragraph that the Green functions of X c 
and X c coincide, and thus, since these are both cadlag Markov processes, they must have the 
same distribution for any initial law. 

4 A characterization result 

The striking property of K-processes that at the entrance time of the process in finite subsets 
(starting from outside) the distribution is uniform (see Remark 2.9) leads to a natural question: 
which other processes have this property? Below we see that, under natural assumptions, the 
answer is none, that is, that property characterizes K-processes. 

Theorem 4.1 Let 7 be as in (2.2) and Y = (Y(t),t > 0) be a process on N* with the following 
four properties. 

(i) Y is cadlag. 

(ii) Y is strong Markov. 

(Hi) Starting from any point i G N* ; Y waits for an exponential time of mean 7(2) before 
jumping. 

(iv) Starting from 00, for any finite A C W , we have ta < 00 almost surely, where 

t a = inf{t > : Y(t) G A}, (4.56) 
with inf = oo, and the law of Y(ta) is uniform on A. 
Then, Y is a K-process with parameters 7 and c, for some c > 0. 
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Remark 4.2 Fukushima and collaborators, as well as other authors, have recently studied one- 
point extensions of certain Markov processes beyond a killing time (see [13, 14] and references 
therein). The K-processes can be viewed as one-point extensions of processes in N* that are killed 
after the first jump. With this point of view, and even though the K-processes don't satisfy some 
of the conditions in the above references (like Condition (A. 2) in [14j; another condition would 
require c = in our case), Theorem 4-1 is similar (in its particular context) to their results. But 
there is an important difference in that, while they depart from a reversibility condition ( more 
generally, a duality condition) with respect to an excessive measure for the process, we have a 
condition on the jump rates and entrance laws. It is nevertheless remarkable that entrance laws 
play a crucial role in their approach (it also could be said that for the K-processes the jump 
rates are directly related to a stationary measure for the process). 

Proof of Theorem 4.1 The strategy is to consider the process restricted to {1, . . . ,n, 00}, 
and show that it must have the same distribution as X^. The result then follows by taking 
n — > 00. 

We start by showing that from any state in N*, Y jumps to 00 almost surely. Let i,j G N* 
be such that i ^ j, and for n > i V j let 

A n = {l,...,n}. (4.57) 

Then 

{Y(r An+1 ) = j} U {Y(r An+1 ) = i, Y{r' n+l ) = 3} C {Y{r An+A{i} ) = j}, (4.58) 

where 

r' n = infO > r An : Y(t) ? Y{r An+1 )}. (4.59) 

Thus, 

Voo(Y(T An+1 ) = j) + Poo(F(r An+1 ) = i, Y{r' n+l ) = j) < P oc (F (r An+A{i} ) = j), (4.60) 
and using (ii-iv) 

111 . 

+ Pu<-, (4-61) 

n + 1 n + l P3 ~ n' V ; 

where pij is the transition probability from i to j. It follows that pij < 1/n, and since n can 
be taken arbitrarily large, we conclude that p^ = 0, and the claim at the beginning of the 
paragraph follows. 

Now let us consider the process obtained from Y by suppressing jumps outside A n : = 
A n U {00} (see (4.57)). Let us call it Y n . More precisely let 



A n (t)= f l An {Y{s))ds and Y n (t) =Y(A; i 1 (t)), 
Jo 



where 1 A is the usual indicator function of a set A, and A^ is the right-continuous inverse of 

A n - 

It is readily seen that A n (t) j t as n | 00 uniformly in t < T for every T. This and (i) 
implies that 

Y n — > Y as n — > 00 in Skorohod space. (4.62) 
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Y n also satisfies (i) and (ii) (see [21], Theorem 65.9). Starting at i < n, it waits an exponential 
time of mean 7(2) and then jumps. 

The state space of Y n may be either A n or A n . (The latter possibility happens if Y is the 
K(7, 0)-process; note that f Q l^ 00 y(Y(s)) ds = almost surely in that case — see the proof 
of Lemma 3.14 for an argument.) If the latter case happens, then Y n is a continuous time 
Markov chain on A n satisfying (i-iii). To completely characterize it, we need only determine 
the transition probabilities. But Property (iv) of Y implies that these must be uniform, that 
is, pij = \jn. This means that Y n is equidistributed with X® defined in (3.24). Now this, 
Lemma 3.11 and (4.62) imply that Y is equidistributed with X°. 

I remains to consider the case where the state space of Y n is A n . In this case Y n clearly also 
satisfies (iii-iv). We need only determine the mean holding time at 00, say 7„(oo). For that we 
reason as follows. 

We can obtain Y n by suppressing jumps of Y n+ i outside {l,...,n}U{oo}. Since upon leaving 
00, the process Y n+ i has probability l/(n + 1) to jump to n + 1, we see that the holding time 
at 00 in Y n can be seen as a sum of independent holding times at 00 in Y n+1 . The number of 
terms in the sum is a geometric random variable with success parameter l/(n+ 1), independent 
of the holding times at 00 in Y n+1 . We conclude that 

f \ i \ n+l 

7n(00j = 7n+l(00) , 

n 

and thus that 7 n (oo) = c/n for some constant c > 0. We then see that Y n is equidistributed 
with X° defined in (3.24) for every n > 1, and the conclusion that Y is equidistributed with 
X c follows exactly as above. ■ 



5 A scaling limit for the REM-like trap model 

The REM-like trap model [1] can be described as a continuous time symmetric Markov chain 
Y n = {Y n (t), t > 0} in the complete graph K n with n vertices such that the average holding 
times r := {t x , x G K n } is an i.i.d. family of positive random variables equidistributed with a 
r.v. t which is in the basin of attraction of a stable law of degree a < 1, that is 

P(r > t) = * > 0, (5.63) 

where L is a slowly varying function at infinity. 

We will show in this section that in an appropriate sense, in an appropriate time scale, Y n 
converges in distribution as n — > 00 to a K-process with c = 0. 

We start by identifying the vertices of K n with A n = {1, ... ,71} for all n > 1, in such a 
way that {r/ n) , 1 < % < n} is in decreasing order (that is, (r[ n \ . . . , t^) is the reverse order 
statistics of (ti, . . . , r n ), an i.i.d. sample of size n of r . 

We can describe Y n then as a continuous time Markov chain in A n with mean holding time 
at i e A n given by t- 11 ^ and uniform in A n transition probabilities for all starting point i G A n . 

Let us view (t~i Tn ■*) as a random measure 7 ra on N* such that 

T i > ttl6A »> (5.64) 
0, otherwise. 
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We refer the reader to Section 3 of [7] for more on the context of the next result. We present 
the main points below. 

Consider the increasing Levy process V x , x G R, V = 0, with stationary and independent 
increments given by 

E [ e ^+* -v*o)] = e axJ~{e i ™-i)w- 1 - a dw ( 5 Q5 ^ 

for any x G R and rr > 0. Let p be the (random) Lebesgue-Stieltjes measure on the Borel sets 
of R associated to V, i.e., 

p((a,6]) = V b - V a , a,b G R, a < b. (5.66) 

Then 

dp = dV = wj 5(x — Xj), (5.67) 

3 

where the (countable) sum is over the indices of an inhomogeneous Poisson point process 
{(xj,Wj)} on R x (0, oo) with density dxaw~ 1 ~ a dw. 
Let now 

c n = (inf{t > : P(r > t) < n" 1 }) -1 . (5.68) 
and 7„ = c„7 n , that is, 7„ is a (random) measure in N* such that 

7„({i}) = l "^' iHGAn ' (5.69) 
I 0, otherwise. 

Let 7 = {7(i), i G N*} denote the weights of p in [0,1] in decreasing order, that is, making 

n = M{x}),xe[o,i]}, 

7(1) = max TZ; ~f(i) = max [TZ \ { 7 (1), . . . , 7 (i - 1)}] , i > 2. (5.70) 

Remark 5.1 7 £/ras defined almost surely satisfies the conditions on the paragraph of (2.2). 

Theorem 5.2 Let Y n be the process in A n such that for t > 0, Y n (t) = Y n (c~ l t). Suppose 
Y n (0) = y n converges weakly to a random variable y in N*. Then, as n — > oo, 

(y n , 7n )^(y,7), (5.71) 

where, given Y is a K(j,0) -process with Y(0) distributed as y, and =3- denotes weak con- 
vergence in the product of the Skorohod topology and the vague topology in the space of finite 
measures on N*. 

Proof We may assume that y n — > y as n — > 00 almost surely. Following the strategy in Section 
3 of [7], we will couple (F n , 7n ) to (Y, 7 ) and establish (5.71) as a strong convergence. 
For i6i n , let 

rf n) = - <?n(^/n-^-l)/n), (5-72) 
C n 

where g>„ is defined as follows. Let G : [0, oo) — > [0, oo) satisfy 

P(Vi > = P(r > x) for all x > (5.73) 
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and let g n : [0, oo) — > [0, oo) be denned as 

g n (x) = c n G^(n 1/a x) for all x > 0. (5.74) 

Let {f\ n \ i G A n } be {f/"\ i G A„} in decreasing order, and 

I 0, otherwise. 

It readily follows from Proposition 3.1 in [7] that 7„ and 7„ have the same distribution for every 
n, and that almost surely 

% — > 7 as n — > oo (5.76) 

(where the first — > in (5.76) means vague convergence). 
Let now J\f and T be as in Section 3. For t > 0, let 



f„(0 = %(y n )T + J2Ux)J2 T i x) > ( 5 - 77 ) 

x=l 1=1 

oo JV t 

f(0 = 7 0>) To + E 7 (x) £ ^ ( 5 - 78 ) 



X=l 1=1 

where we write %(x) and 7(2;) for 7 n ({:r}) and 7({x}), respectively, and 

} y n , ao<t<%(y n )T , 

' " S x, tit n (aW-)<t<t n (al x) )foisomel<x<n,j>l. { ' ' 

y, if0<t<7(^)T , 
Y{t) = { x, if f {af ] -) < t < t{af ) ) for some 1 < x < oo, j > 1 (5.80) 
oo, otherwise. 

See (3.20), 3.21), (3.23,3.24) above. One readily checks that (Y n ,%) has the same distribution 
as (Y n ,%) for every n > 1 (see Proposition 3.1 of [7]). 
We claim now that 

y n -> y as n -> oo (5.81) 

almost surely in Skorohod space. 

The proof of (5.81) is similar to that of Lemma 3.11, with modifications to account for a 
dependence of % on n. (5.76) is of course crucial. We indicate the main steps next. 

For n> y, m G N*, let S m , {S™ < S™ < . . .} and L™ be as in that proof. We now have that 
min <i<Lm_ 1 [f n (S 1 ™ 1 -)-f n (S 1 f)] > almost surely for n > 1. Define next A™ : [0, f n (S^)] -> 
R + as follows. 

K(t) = -^-t, if0<t<7n(^n)T , (5.82) 
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and for < i < L™ - 1 and T n (Sf) < t < r n (^), let 

r(g^ 1 -)-f(5r) 



Kit) 



r(<Si+i — ) + f^s^j-f^s™^-) ~~ r„(S' l ™ 1 — )], if f n (S'™ 1 — ) < t < f n(5 , « r +i)- 



(5.83) 

It has the following properties. For all T > 0, m G N* and n> mV y 

snp |A^(0-t|<max{|f(5r-)-r„(5T-)l, |r (5T) " ^Dl; < i < L™} , (5.84) 



where f n (0— ) = f (0— ) = 0, and the right hand side of (5.84) vanishes almost surely as n — > oo. 
Furthermore, 

sup dist (Y(\™(t)),Y n (t)) < 8 m , (5.85) 

0<t<T v ' 



since for t G [0,T], Y(\™(t)) and F„(t) coincide when either one is in {1, . . . , m}. 

The remainder of the argument follows along the exact same lines as those in the proof of 
Lemma 3.11. ■ 



5.1 Aging 

Aging results can be viewed as scaling limits for averaged two-time correlation functions of a 
given dynamics of a disordered system. The averaging is with respect to the disorder distri- 
bution. The system should be started at high temperature, and then abruptly cooled down, 
evolving thence on at low temperature. Loosely speaking, aging would amount to the follow- 
ing. Given a dynamics described by the process X with a disordered set of parameters r, the 
following would be an aging result. 

lim E{E M [$(M';X)|r]} =K(6), (5.86) 

where fj, is a measure on state space; E jU (-|r) indicates the expectation with respect to X with 
initial distribution given by /i, with parameters fixed at r; $(t,t';X) is a function of the piece 
of trajectory X([t, t + t']) = {X(s), s G [t,t + £']}; and 1Z is a nontrivial function of real scaling 
factor 9 > 0. The initial distribution /i should reflect a high temperature, and the distribution 
of the parameters, a low temperature. See [3] and references therein. 

For a mean field model like the REM-like trap model, there is a volume dependence, and 
one must take the infinite volume limit (n — > oo); that should be done before or together with 
the time limit. The former is done in [1] for 

$!(M';X) = l{X(s) = X(t), s G [t,t + t']}. (5.87) 

H — n n is taken uniformly distributed in {1, . . . , n}, reflecting the high temperature of the initial 
state, and the tail parameter a < 1 corresponds to the low temperature thence prevailing. 
One other function that is often considered is 

$ 2 (t, t'; X) = l{X(t) = X(t + t')}. (5.88) 
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One could also take the volume and time limits together, using the scaling limit of The- 
orem 5.2. For that let us suppose that, for all t,t' > 0, $(£,£'; •) is almost surely continuous 
(with respect to the distribution of (Y, 7)). Then, by Theorem 5.2, 

$(t, Y n ) I r] } = E {E 00 [$(t, t'; F)| 7]} , (5.89) 

with F(0) = 00, where for x G N*, E x (-|7) denotes the expectation with respect to the distri- 
bution of F started at x, with parameters fixed at 7. t, t' > are now macroscopic. On those 
times the dynamics is already close enough to equilibrium to disallow aging: the right hand 
side of (5.89) is not a function of the ratio t'/t only. To find aging, we should move away from 
equilibrium, by taking the further limit as t, t' — > while t'/t — > 9 > 0. We then say that aging 
takes place in this context (for both the trap model and the limiting disordered K-process) if 

lim E{E oo mt,t';Y)\ 1 ]} = n'(9) (5.90) 

t,t'—>a 

exists and TV is nontrivial. 

Remark 5.3 In taking the volume and time limits as in [1], one enters what could be termed 
a (long) microscopic time aging regime for the trap model, while the latter way of taking those 
limits gets one in a (short) macroscopic time aging regime. Our next result indicates that, at 
least as far as $1 is concerned, the two regimes agree. 

Remark 5.4 Instead of scaling time as in (5.89), namely with the scale of the largest t x 's in 
K n , in view of the further limit lim^^o; t'/t->0> it is natural to use a lower order (divergent) 
scaling. This could be termed a mesoscopic aging regime, and it is the approach of [11] to 
establishing aging for the REM-like trap model. As far as $x is concerned, the mesoscopic 
aging regime agrees with the microscopic and macroscopic regimes; see [11]. In the mesoscopic 
time scaling (as well as in the long microscopic time scaling), the dynamics itself doesn't have 
a limit though. 

Next we state an aging result for $ in a certain class of functions including the usual 
examples $1 and $2 an d satisfying some continuity and spatial homogeneity conditions (which 
seem natural if one sees this as a mean field model), with no intention at full generality, however. 
Let II be the space of cadlag paths on N*, and consider the class of functions $ : M + x M + x U — > 
M with the following properties. 

^(t,t';C) = ^(t,t';C([t,t + t'])), (5.91) 

where £([£, t + 1']) is ( restricted to [t, t + t'], with the scaling property: for all t, t' > 0, 

$(t,t / ;C) = $(l,t , A;C*), (5.92) 

where £*(•) = £(£•). Notice that $1 and $2 above have this property. Consider now the following 
path segments; for 9 > 0, x G N*: r] xfi = r) x>e ([l, 1 + 9)) = x; fj x>e = r) xfi ([l, 1 + 9\) = x. We 
make the following further assumptions on $: 

$(l,6;fix,e)=M0) VzGN*, (5.93) 



lim E {e 

1— +00 I 
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for some real function #1, that is, $(1, 0; r) x j) doesn't depend on x for finite x; for < s < 9, 

$(1, 0; r) x , s o 77) = S(x, s, 77) Wx G N* (5.94) 

for all segment 77 = ?7([l + s, 1 + 0]) in [1 + s, 1 + 0] of a path in Skorohod space with 77(1 + 5) 7^ x, 
where o stands for concatenation, and S is a given function with the following properties. We 
first give some definitions. For r > 0, let IT U be the space of cadlag paths in N* of length u, 
and for v > fixed, let X v = l) ue [o iV ]({u} x U v - U ). Let now 9 > be fixed. We then have that 
S : N* x -> R such that 

(i) S is uniformly bounded; (5.95) 
(77) for all 7/ G ITfl-s, S(x, s, 7/) = S(y, s, 7/) whenever x,y i]; (5.96) 
(777) for all x G N*, the function 77 — > S(x, s, 77) is continuous m i/ie sup norm on 

n e _ s for 77 = 7700,0-., G Il e _ s with fj^e-s = °o, uniformly in < s < 9. (5.97) 

Remark 5.5 $1 and <3> 2 given in (5.87,5.88) satisfy (5.91-5.97). Other examples can be ob- 
tained by taking S(x, s,i]) = f(s) for all x G N* ; 77 G He- S , where f is any continuous function 
in [0, 0] . 

Remark 5.6 The uniformity assumption in (5.97) above is for simplicity. See Remarks 5.14 
and 5.16 below. 

Remark 5.7 The lack of dependence on finite x assumed in both (5.93) and (5.96) is not arti- 
ficial if one takes into account that the model where <£> will be measured is mean-field, and thus 
the space coordinate isn't relevant. The distinction between finite x and infinity is nevertheless 
desirable. 

For x G N* and < s < 0, let ^ 2 {s,9) = E(x, s, 77 00j6 i_ s ). Notice that the latter function 
doesn't depend on x G N* by Assumption (77). We make the following assumptions on #2, for 
simplicity: for all > 

tf 2 (O,0) :=lim* 2 (s,0), #2(0,0) := limtf 2 (s,0) exist (5.98) 

sj.0 s|6» 

and 

*' 2 M) := -^M) e MM, dx). (5.99) 
as 

We can now state the main results of this subsection. For simplicity, we make t' = 9t. We 
start with a particular case. 

Theorem 5.8 For 7 as in (5.65-5.70), $1 as in (5.87), andt,9 > 0, let 

A t (6)=E 00 [$ 1 (t,et;Y)\>y]. (5.100) 
Then almost surely for every 9 > 

jimA t (0) = A(0), (5.101) 
where A is a (nontrivial) function to be exhibited below (see (5.147) and (5.148)). 
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Remark 5.9 This is an almost sure aging result. The averaged form of (5.89) follows by 
dominated convergence. 

Remark 5.10 As anticipated in Remark 5.3 above A is the same as the one obtained in [1] 
by taking limits in a different order and in a different way (see the discussion before and up to 
that remark). The computation of the limit in that reference is not thoroughly rigorous; in [6] 
a rigorous derivation in the same spirit of [1] is performed (in Proposition 2.8 of the former 
reference). 

Corollary 5.11 Let $ be as in (5.91-5.99). If (5.101) holds, then 

limE oo [$(t,W;y)|7] = * 2 (O,0) + [*i(0)-* 2 (0,0)]A(0)+ / %(s,6)A(s)ds. (5.102) 

Jo 

Remark 5.12 For the above result, we may take 7 fixed such that (5.101) holds (as well as 
the assumptions on the paragraph of (5.70)). 

Remark 5.13 For both $1 and $ 2 (see (5.87,5.88)), we have *i = 1 and ^ 2 = 0, so, 
from (5.102), A(0) is their common aging limit. 

Remark 5.14 A turns out to be continuously differentiate in [0, 00); we can thus integrate by 
parts in the right hand side of (5.102) to obtain that 

lim 0*;y) I 7] = #i(0)A(0) - / # 2 (s, 6) M{s) ds, (5.103) 
* _>0 Jo 

where A'(s) = ^A(s). For the result in this form we don't require the uniformity assumption 
in (5.97), nor Assumptions (5.98,5.99). See Remark 5.16 below. 

Remark 5.15 In the proof of Corollary 5.11 below, we will use the fact that for each 7 sat- 
isfying the conditions of the paragraph of (2.2) — in particular, for each 7 in a full measure 
event, see Remark 5.1 above — , and all t > 0, the distribution of Y l given 7 is the same as 
that of Y given 7* := t" 1 ^. This follows immediately from the definition of K-processes (see 
Definition 3.1 and preceding paragraphs) . We thus have that for all such 7, and all bounded 
measurable function F on Skorohod space, 

E [F(y*)| 7] = E [F(y)| 7*] . (5.104) 

Proof of Corollary 5.11 Consider the conditional expectation on the left hand side of (5.102). 
By the scaling property of <3> (5.91,5.92), we have that it can be written as 

E[$(l,0;y*)| 7 ] =E[$(l,0;y)| 7 *] 4 . (5.105) 

For computing the righ hand side of (5.105), we first condition on y(l) and on whether or 
not there is a jump of Y in [1, 1 + 0], and then if there is, at which time point it takes place. 
We get from that and (5.93,5.94) 

4<P(l,0;y)| 7 f ] 

4 From now on we write Poo and as P and E, respectively, using the subscript only for finite initial points. 
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= tfi(0) P ( y i = x \^) e ~ etHx (5.106) 

x&l* 

J2nYi = xW) I -e- st ^E[E(x,s,Y [0 , e - s] )\^]ds, (5.107) 



where the sum can be taken in N* due to Lemma 3.14, and we have used time homogeneity of 
Y. 5 

We first note that the sum in (5.106) equals A t (9). Indeed 



A t (0) = ^P(r t = x| 7 )P :E (nojumpofr in [t,t + 0t]| 7 ) 

= P ( F * = X M e ~ 9thx = P ( Fl = x ^ e~ dthx , (5-108) 



x€N* xGN* 



where we have used the fact alluded to in Remark 5.15 above in the the third equality. We now 
write the expression in (5.107) as 

[ 6 E[Z(1, s,}^]) |f] P ( Fl = Al l )-e- sthx ds (5.109) 

JO 1X 

plus an error that is bounded above by 

sup |E[S(1, 3,^0,^)17*] - E[S(x, s, ^0,^)17*] | ■ (5.110) 

x£N*,s£(0,e) 

From (5.96), the absolute value of the difference of expectations in (5.110) can be bounded 
above by constant times 

sup F[l,x<£ Y m H] = sup F[l,x i = sup F\T^\t9) < a\ V <t?| 7 ], (5.111) 

xgn* xeN* xeN* 



where for s > 



JV<»> 



TM(s)= E^E T ^- ( 5 - 112 ) 

y^l,x i=l 

Thus, the right hand side of (5.111) is bounded above by 

F[T(t0) < T'| 7 ], (5.113) 

where T' is a continuous random variable independent of Y. It is clear from the fact that 
lim s ^or(s) = that (5.113) vanishes as t — > 0. 

We thus only have to consider (5.109). It can be written as 

r e t r e 

/ V 2 (s,6) P ( y i = x h t )— e ~ Sthx ds= - / y 2 (s,9)A' t (s)ds, (5.114) 

^0 xeW lx Jo 



3 We have made notation more compact by substituting parentheses with subscripts. 
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where A' t (s) 



-£A t (s) 6 , plus an error that is bounded above by 



sup \E[E(l,s,Y lo ,e-s])\'Y t ]-*2(8,0)\= sup |E[S(1, s, Y^-^lf] - s, Tfeo,*-,)!- (5.115) 
se(o,6») se(p,6) 

From (5.96,5.97), given e > 0, there exists 5 > such that the difference in (5.115) can be 
bounded above by constant times 



e + P ( sup dist(Y~(s), oo) > 5 

,O<s<0 



7 



(5.116) 



Since, under 7*, Yjo^j converges in the sup norm to the identically in [0, 9} infinity path as t — > 0, 
we conclude that the expression in (5.115) vanishes as t — > 0. 
We are thus left with taking the limit of 



tt 2 M)Ai(s)cfe = tt 2 (M)A t (0)-tt 2 (O,0)- / tt' 2 (s,0)A t (s)cfe 



(5.117) 



as t — > 0, where we have used the assumptions we made on \I/2 (5.98-5.99) to integrate by parts; 
note that A t (0) = 1. Collecting (5.106-5.117) and the above arguments together with the L\ 
assumption (5.99) on \I> 2 , the result then follows by (5.101) and dominated convergence, since 
A t is bounded (by 1). ■ 

Remark 5.16 An alternative, longer argument for the validity of (5.102) in the form (5.103) 
for almost every 7, which has the advantage of requiring neither the uniformity assumption 
in (5.97) nor Assumptions (5.98,5.99) — see Remark 5.14 above — is to establish the con- 
vergence of A' t as t — > to a (deterministic) function A' (which turns out to be the derivative 
of A) for almost every 7. This can be done in an entirely similar fashion as in the proof of 
Theorem 5. 8 below. We leave the details for the interested reader. 

Proof of Theorem 5.8 

It is enough to get the result for a fixed 6 > 0. That we can find a full measure set of 7's, 
such that the result holds for all 9 > simultaneously, follows from the monotonicity of $1 and 
the continuity of A in 9. 

We start with a simpler argument (at this point) for a weaker result, namely the a.s. con- 
vergence of a (double) Laplace transform of E [$i(-, •; Y)\ 7]. This requires the construction and 
results of Section 2 only. Consider the function c\(n) defined in (2.14). We can represent it as 
follows. 

/'OO /»oo 

c x (n)=\nl / e-^e-^Q^s^Y^dsdt, (5.118) 
Jo Jo 

with c\ defined in (2.14). For an aging result, it's natural to take ji = 9\, and then take the 
limit as A — > 00. From (2.15), we have 



cx(X9) = 



E 



A7O) A67Q) 
x 1+A7(x) l+\6-y(x) 



E 



x 1+A7(x) 



(5.119) 



6 It is a straightforward exercise to show that the differentiation sign commutes with the sum. 
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Before taking the limit, we note that both sums in (5.119) can be seen as sums over the 
increments of the Levy process V in [0, 1] (see paragraph of (5.69) above) of a function of the 
rescaled increments. We thus have by the scale invariance property of V that the right hand 
side of (5.119) for every A > has the same distribution as 

Z^e[0,A«] l+ 7 '(j/) l+0 7 '(x)_ ^ 12Q -j 



E 



7' fa) 

ye[o,\ a ] l+V (2/) 



where the sum is over the increments {7^.} of V in [0, A a ]. Now the law of large numbers says 
that each factor in the quotient on the right hand side of (5.136) converges almost surely to 

EV r , t'M WW f°° m e w -i-q 7 

^2^e[o,i] i + y (y ) i+e 7 '(x) Jo aw f^ion 

^2^e[o,i] 1+7'fa) j o i+w w uw 

as A — > 00. 

Remark 5.17 T/ioi m principle says that the convergence of c\(\9) as A — > 00 /ioWs m profr- 
ability; standard arguments relying on large deviation estimates for the sums on the right hand 
side of (5.121) imply convergence almost everywhere. 

Remark 5.18 As we'll see below (in Remark 5.20), the expression in the right hand side 
of (5.121) coincides with A as a function of 9. 

We now give a full argument (independent of the above one). This argument uses the 
construction and results of Section 3 only. 
The argument relies on an estimate for 

P(y* = a;|7). (5.122) 

For x E N*, {Y t = x} can be decomposed in the disjoint union of 

{I^VP) < t, TW(a[ x) )+ lx Tl x) > t}, (5.123) 

where := as in (3.53), and an event where 7a . t[ x) < t and (a^) < *■ We thus have 

|P(y t = x\ 1 )-F(r^\s 1 ) <t, tW( Si )+ 1x tI x) >t\ 1 )\ < (i- e -i)P(rW(5 2 ) <t| 7 ), (5.124) 

where Si and S2 — Si are i.i.d. rate 1 exponentials which are independent of all other random 
variables around. 

To establish the result we will prove the two following assertions. 

Ex^e-^pcrw^) <t, tW(Si) + 1x tI x) >*| 7 ) -> A(0), (5.125) 

E^eN* ^ 0thx n? {x \S 2 ) < i| 7 ) - (5.126) 
as t — > for almost every 7. We rewrite the probability in (5.125) as follows. 

P(r^(Si) < t| 7 ) - nrW(Si)+ lx T} x) < f| 7 ), (5.127) 
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and note that the second term equals 

I e' {t ~ s)hx ¥{Y^ x \S 1 ) < s\i)ds= [ e^ 1 ' 3 ^* P^^) < s*| 7 ) ds. (5.128) 
Jo Jo 

Substituting in the left hand side of (5.125), one sees that in order to prove the convergence in 
that display, it is enough to establish 

E, eN * e~ ethx P(rW(5i) < t\i) -> A(0), (5.129) 
Jo E*eN* e-« 1+ *)-^ P(rW(50 < st| 7 ) cfa - A(0) (5.130) 

as i — > for almost every 7, where A and A are functions of 9 only to be given below (see (5.141) 
and (5.146)); we then have A = A — A. 

Remark 5.19 We note that the left hand sides of (5.129,5.130) are both bounded above by 
XLeN* e ~ 6t ^ lx , which is almost surely finite for every 9,t > 0, since XLeN* 7^ < 00 almost 
surely. They are thus almost surely finite. 

We now observe that for almost every 7, < < T for all x £ N*, where the first 
domination is a stochastic one (given 7), and follows from the decreasing monotonicity of 7. 
To get (5.126), it suffices then to prove that for almost every 7 

P(r (1) (S 2 ) < i| 7 ) ^ ethx ^ as t ^ 0. (5.131) 

xen* 

For (5.129,5.130), it suffices to prove that for % — 0, 1 

P(rW(5x) < f | 7 ) E, eN * e"" /7b - A(0), (5.132) 
£ P(rW(5x) < Z xm * i e-^)-^h, ds _ ~ m (5.133) 

as t -> 0, where T (0) = T. 

The next step is to replace, for < s < 1, i — 0, 1, j — 1, 2, P(rW(5j) < st| 7 ) by constant 
times ^((st) -1 ), where for r > Wy(r) := E(exp{— r rW(5j)}| 7 ). This relies on a Tauberian 
theorem (see Theorem 3, Section 5, Chapter XIII of [22]), stating that as t — > 0, the quotient 
of the former quantity to the latter one converges to 1/Q(ja) provided that for almost every 7 

lim = q~ 3a for all q > 0, (5.134) 

where, for a > 0, Q(a) = t a e~ l dt. 

(5.134) is established in Lemma 5.25 below. From Lemma 5.23 and (5.152), we have that 



< ^(r 1 ) ^ e - et/ ^ < 2- ( 5 - 135 ) 



rrGN* 
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Arguing as in the sentences above (5.120), we have that the right hand side of (5.135) for 
every t > has the same distribution as 

V p- h'y t aS T p- e h'y 

^[o,*-]* _ f lWf _ ? (5.136) 



(T -^-V -^-V 



where the sum is over the increments {7^.} of V in [0,t~ a ]. Now the law of large numbers says 
that each factor in the quotient on the right hand side of (5.136) converges almost surely to 
positive finite numbers as t — > 0. The extra factor of t a in front of that expression then makes 
it vanish in that limit. That the same holds for the right hand side of (5.135) follows as in 
Remark 5.17 above. 

To get (5.132), we again need only get the limit for 

Mr 1 ) E e ~ 6thx ( 5 - 137 ) 

x&i* 

which by Lemma 5.23 and (5.152) is bounded above and below by 



(5.138) 



k + Ex i+ t -i 7a 

k = and 1, respectively. As in (5.136), for every t > 0, (5.138) has the same distribution as 

'j/e[o,t- 



1 Z^«e[o,t-«l e 



' 5 



ftt + 6 Z^, e [o,t-«] i+ 7 ; 
which by the law of large numbers converges almost surely as t — > to 

E (E tfe[ o,i] e_9/7 _ / °° e - e /-^-( 1+a ) rf w 

^ ^ tf 6[0,l] T+% ) Jo 1+w 

An analogue of Remark 5.17 holds also here. We thus have from the above that 



(5.139) 



(5.140) 



1 r e~ e l w w- {1+a Uw 

w = W) Kter^>*» - (5 - 141) 

It remains to get (5.133). Since P(rW (£_,■) < siM/c^st) -1 ) -> l/<?(a) as t -> uniformly 
in s G (0, 1], it suffices to get the limit for 

I" uaiist)- 1 ) -e'^'^ ds, (5.142) 
which by Lemma 5.23 and (5.152) reduces to getting the limit for 



(-1 -y _L e -((i+0)-s)t/7* 

/ — JX 1x 
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ds, (5.143) 



k — 0, 1. It is clear that the quotient in the above integral, call it A Sjt (#), is bounded above 
by Ai )t (0), and the latter converges as t — > almost surely (to A(6>), as we just saw). It thus 
suffices to establish the almost sure limit of A Sjt (9) as t — > (independent of fc = 0, 1) for every 
s E (0, 1]. That again works as above: A Sjt (0), for every t > 0, (5.143) has the same distribution 

as 

s Q — — — . (5.144) 

k(st) a + (st) Q J2 y e[o,(st)-<*] TT% 

By the law of large numbers, the quotient in (5.144) converges almost surely as t — > to 

e/V 7 ~ r^w-^dw • (5,145) 

Again we have an analogue of Remark 5.17 here as well. We thus have from the above that 

1 ^ ( n °° S a e -{^e)-s)/ Ww -{2+a) dw ds 

A(,)= w - ;r^-~ — • (5 - 146) 

The result for fixed 6 > is thus established with 

A = A — A, (5.147) 

with A, A given in (5.141), (5.146), respectively. ■ 

Remark 5.20 It can be shown (e.g., by taking Laplace transforms), that A thus obtained co- 
incides with the limit obtained in [1] and [6]; in other words 

= sinfjm) r 1 _ d ^ 

See Remark 5.10 above. It also coincides with the expression in the right hand side of (5.121) 
as a function of 9. See Remark 5.18 above. 

Remark 5.21 By (5.108), we see that 

A t {6) =E(V e ' /7 n| 7 ) , (5.149) 

so Theorem 5.8 and (5.148) establish that, for almost every 7, t/jy converges in distribution 
as t — > to the random variable Z whose Laplace transform K(e~ 9Z ) is given by the right 
hand side of (5.148). This is another way of understanding the basic mechanism for the aging 
phenomenon in this process (there's no change for a time of order t when the process has aged 
t units of time). It is also a macroscopic version of the last assertion of Proposition 2.10 of [6]. 

Remark 5.22 Lemma 2.11 of [6] establishes the continuity of the distribution of the random 
variable Z in Remark 5.21. From (5.141,5.146), one readily finds its density with respect to 
Lebesgue measure, given by 



Q{a) f™w- a (l +w)- l dw 



z*- 1 f a S"- 1 e-^- s)z ds, z>0. ( 5. 1 50) 

Jo 
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Lemma 5.23 For i — 0,1, j — 1, 2, and almost every 7 
Proof Exercise. 

Remark 5.24 TTie condition x ^ in the sum in (5.151) (in the case when i = 0) is empty 
since x > 1. From (5.151), we have that for i — 0, 1, j = 1, 2 

Lemma 5.25 (5.134) holds for almost every 7. 

Proof For a fixed A > 0, and then for all rational A > 0, it follows from (5.151) and a law of 
large number argument as in the proof of Theorem 5.8. The result for all A > can be argued 
from that, using the monotonicity of Wy(-) and the continuity of the limit. ■ 
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